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instructional processes in higher education. {Author/HS) 



O 

ERIC 



A?- 




cvi 

o* 






FINAL REPORT 






U4 



Project No. 7-D-048X 



Grant No. OEG 3-7-070040-4238 



WEST TENNESSEE RESEARCH DEVELOPMENT CONSORTIUM 



June, 1969 






U.S. DEPARTMENT OF 
HEALTH, EDUCATION, AND WELFARE 



n 





Office of Education ^ ; 

Bureau of Research 



EDUCATION & WELFARE 

OFFICE ©F EDUCATION 
THIS DOCUMENT HAS UfcEM RiPRQ 
DUCED EXACTLY AS received FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT. POINTS OF VIEW OR OPIN- 
IONS STATED DO NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



1 



FINAL REPORT 



WEST T 



O 

ERIC 



Project No. 7-D-048X 
Grant No. OEG3- 7-070040-4238 



ENNESSEE RESEARCH DEVELOPMENT CONSORTIUM 



June, 1969 



D.S. DEPARTMENT OF 
HEALTH, EDUCATION, AND WELFARE 

Office of Education. 
Bureau of Research 



2 



FINAL REPORT 



Project No* 7-D-048X 
Grant No* OEG 3-7-070040-4238 



NEST TENNESSEE RESEARCH DEVELOPMENT CONSORTIUM 

Dr. James W. Colmey, Director 

Mr. John R. Petry, Instructional Processes 
an Research Instructor 

Memphis State University 

Memphis, Tennessee 38111 

June, 1969 



The research reported herein was performed pursuant to a grant 
with the Office of Education, U.S. Department of Health, Educa- 
tion, and Welfare. Contractors undertaking such projects under 
Government sponsorship are encouraged to express freely their 
professional judgment in the conduct of the project. Points of 
view or opinions stated do not, therefore, necessarily represent 
official Office of Education position or policy* 



U,S. DEPARTMENT OF 
HEALTH, EDUCATION, AND WELFARE 

Office of Education 
Bureau of Research 




3 



TABLE OF CONTENTS 



Page 

LIST OF TABLES , ill 

SUMMARY I 

INTRODUCTION . « 3 

METHODS . , , , A 

FINDINGS AND ANALYSIS , 5 

CONCLUSIONS AND RECOMMENDATIONS 30 

APPENDIX A TEST CONSTRUCTION TREATMENT AND 

CRITERION TEST 38 

APPENDIX B EDUCATIONAL MEDIA TREATMENT 64 

APPEND DC C PURDUE RATING SCALE FOR INSTRUCTION 71 

APPENDIX D STANFORD TEACHER COMPETENCE 

APPRAISAL GUIDE 74 

APPEND K E MEANS AND STANDARD DEVIATIONS BY 

ITEM AND BY FACULTY MEMBER ON THE 

PURDUE AND STANFORD SCALES 76 



11 




4 



Table 

1 



Page 



LIST OF TABLES 



Comparison of Pre- test/Post- test Scores of Lane 
College Teachers Using T-test on Items of the 
Purdue Rating Scale for Instruction, Fall ,1968 ... 7 

2 Comparison of Pre-test/Post- test Scores of Lane 
College Teachers Using T- test on Items of the 
Stanford Teacher Competence Appraisal Guide, 

Fall, 1968 . a . ■ *, • n t • m -» « • r * . * • 4 m S 

3 Comparison of Pre-test/Post- test Scores of Freed- 
Hardeman College Teachers Using T*test on Items 
of the Purdue Rating Scale for Instruction, 

Spring, 1969 „ . 9 

4 Comparison of Pre- test/Post- test Scores of Freed- 
Hardeman College Teachers Using T-test on Items 
of the Stanford Teacher Competence Appraisal 

Guide, Spring, 1969. 10 

5 T- test on Lana College Faculty by Comparing 
Pre- test /Post- test Scores on the Purdue Rating 

Scale for Instruction, Fall, 1968. . * H 

6 T- test on Lane College Faculty by Comparing 
Pre-test/Post* test Scores on the Stanford 

Teacher Competence Appraisal Guide, Pall, 1968 t . . 12 

7 T-test on Freed"- Hardeman College Faculty by 

Comparing Pre- test /Post- test Scores on the Purdue 
Rating Scale for Instruction, Spring, 1969 13 

8 T-test on Freed* Hardeman College Faculty by 
Comparing Pre- test /Post- test Scores on the Stan- 
ford Teacher Competence Appraisal Guide, 

Spring, 1969 . . 14 

9 Difference Scores Matrix for the Purdue Rating 
Seale for Instruction for Lane College, 

Fall, 1968 IS 



LIST OF TABLES (Continued) 



Table 

10 

11 

12 

13 

14 

15 

16 

17 

18 



Difference Scores Matrix For the Stanford 
Teacher Competence Appraisal Guide for Lane 
College, Fall, 1968 



Difference Scores Matrix for the Purdue Rating 
Scale for Inst action for Freed-Hardeman College, 
Spring, 1969 



Difference Scores Matrix for the Stanford 
Teacher Competence Appraisal Guide for Freed- 
Hardeman College, Spring, 1969 , . , « 

Comparison of Pre- test/Post- test Scores of 
Freed-Hardeman College Teachers Using T-test 
on Items of the Purdue Rating Scale for 
Instruction, Fall, 1968 

Comparison of Pre- test/Post- test Scores of Freed- 
Hardeman College Teachers Using T-test on Items 
of the Stanford Teacher Competence Appraisal 
Guide, Fall, 1968 

Comparison of Pre- test/Post- test Scores of Lane 
College Teachers Using T-test on Items of the 
Purdue Rating Scale for Instruction, Spring, 1969. 

Comparison of Pre- test/Post- test Scores of Lane 
College Teachers Using T-test on Items of the 
Stanford Teacher Competence Appraisal Guide, 

Spring, 1969 

T- test on Freed-Hardeman College Faculty by 
Comparing Pre- test/Post- test Scores on the Purdue 
Rating Scale for Instruction, Fall, 1968 

T-test on Freed-Hardeman College Faculty by 
Comparing Pre- test/Post- test Scores on the Stan- 
ford Teacher Competence Appraisal Guide, 

Fall, 1968 



iv 



6 



Page 
. 16 

. 17 

, 18 

. 20 

. 21 
. 22 

. 23 

. 24 

25 



LIST OF TABLES (Continued) 



Table 

19 T- test on Lane College Faculty by Comparing 

Pre- test/Post- test Scores on the Purdue Rating 
Scale for Instruction, Spring, 1969* 

20 T-test on Lana Collage Faculty by Comparing 
Pre- test/Post- test Scores on the Stanford 

Teacher Competence Appraisal Guide, Spring, 1969 . . 

21 Difference Scores Matrix for the Purdue Rating 
Scale for Instruction for Freed- Hardeman College, 

1968 

22 Difference Scores Matrix for the Stanford 

Teacher Competence Appraisal Guide for Freed- 
Hardeman College, Fall, 1968 , , * , . . 

23 Difference Scores Matrix for the Purdue Rating 
Scale for Instruction for Lane College, 

Spring, 1969 * 

24 Difference Scores Matrix for the Stanford 

Teacher Competence Appraisal Guide for Lane 
College, Spring, 1969 * 

25 Comparison of Pre- test/Post- test Scores of Freed- 

Hardeman College Faculty on the Test Construction 
Treatment, Fall, 1968 „ . • 

26 Comparison of Pre- test/Post- test Scores of Lane 
College Faculty on the Test Construction Treat- 

, Spring, 1969 ■ •*«#*#•■■■■•***. 

27 Comparison of Frequency of Significant X- Value 

Scores of the Faculty of Lane College and Freed- 
Hardeman College on Items of the Purdue Rating Scale 
for Instruction and on the Stanford Teacher Compe- 
tence Appraisal Guide, 1967-1969 # * . # 

28 Frequency of Significant T- Value Scores of Teachers 
of Freed- Hardeman College and Lane College on the 
Purdue Rating Scale for Instruction and the Stanford 
Teacher Competence Appraisal Guide, 1968-1969. „ . . 



Page 

26 

27 

28 
29 

31 

32 

33 

34 

35 



36 



West Tennessee Research Development Consortium 



SUMMARY 

The West Tennessee Research Development Consortium was formed 
to increase research potential in two developing West Tennessee 
colleges; Freed-Hardeman College , Henderson, Tennessee, and Lane 
College, Jackson, Tennessee, The Consortium consisted of a propo- 
sal and project designed (1) to train in research methodology one 
person on each of the two college campuses (whose student bodies 
average 900), and (2) to offer concurrently an in-service training 
program (to eight faculty members in each of these two colleges). 

The in- service training program sought to try out a series of in- 
structional materials designed to upgrade teaching on the higher 
education level,. One of the treatments centered around test con- 
struction /!/; the other was designed to improve and increase skills 
in the use of educational media /2 /, 

The research development program sought to achieve the follow- 
ing objectives; (1) to develop or advance research competencies 
in selected personnel on the campuses of the two cooperating colleges 
through conducting a cooperative research venture; (2) to expose 
the staffs of each of these colleges to the opportunity to observe 
and participate in an on- going research project while gaining the 
benefits of an in-service training experience; (3) to demonstrate 
the importance of research as a discipline or an instructional meth- 
od, or as a decision-making instrument, to these two developing in- 
stitutions; (4) to develop curriculum materials which will aid in 
the maintenance quality of instruction in developing institutions 
through in-service programs; and (5) to study the treatment effects 
of curriculum packages designed to upgrade the instructional pro- 
cesses in higher education,. 

A two-hour faculty seminar was held every other week at each 
campus during which the experimental treatments were discussed. 

The researcher at Memphis State University provided assistance in 
the administration and development of the curriculum packets and 
interacted with consultants specifically hired to help develop the 



L See Appendix A, pp. 38=59, 



-See Appendix B, pp. 64-70, 
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curriculum packets,, The group of eight faculty personnel on each 
campus who received experimental instruction were evaluated by 
students in one of their classes through two rating instruments , 
the Purdue Rating Scale for Instruction (Qi) / 1 / and the Stanford 
Teacher Competence Appraisal Guide (02) /2/* Also , the Test Con- 
struction unit was preceded and followed by a criterion test (O 3 ) 
/3/. Using 0 for the criteria assessment and T 3 (Test Construc- 
tion) and T 4 (Educational Media) for the treatments, the general 
design for the year was the following: 

Semester Semester 



Group 1 


010203 


1 

T 3 


010203 


O1O2 


2 

t 4 


0102 


Group 2 


0x02 


t 4 


°1°2 


O1O2O3 


T3 


OXO 203 



The Instructional Processes Instructor from Memphis State Univer- 
sity coordinated the overall instruction program and with the In- 
stitutional Researchers administered each of the treatments. 

The statistical data /4 / of the in- service training program 
revealed a differential effect on both rating instruments over 
both treatments. Though significant changes toward improvement 
were shown on both items and faculty members , more instances of 
significant negative changes were recorded, particularly on items. 
The differential effect could have been influenced by an inade- 
quate treatment basis, the gaining of sophistication by student 
raters, or the relationship between the rating instruments and the 
treatments . 



Despite the inconsis teney of the results of testing the two 
packets of curriculum materials, considerations can be made for 
continuing this program. The Institutional Researchers have ex- 
pressed a desire to continue administering the project because 
of gains in their own research skills and Interests, The atti“ 
tude of the faculty members toward research has been positively 



l$ee Appendix C, pp* 71-73. 

^gee Appendix D , pp. 74-75, 

3 

See Appendix A, pp B 60-63, 

/4 See Appendix E for Means and Standard Deviations on the Pur- 
due and Stanford scales, pp. 76-96. 
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influenced and their participation in research projects has been 
increased. Not least 3 the presidents of both institutions have 
expressed a desire for continuance of the program, partly because 
the Consortium has been a leaven for increasing interest among 
faculty members not directly involved in the project* 

The additional treatment proposed for the third year of the 
Consortium offers the possibility of significant gains among par- 
ticipating faculty members because knowledge of the contents of 
the curriculum packet is not widespread. The materials discussed 
through the second year - the lecture method, the discussion meth- 
od, the educational media, and the test construction - have been 
more familiar than that proposed for the third year* Because 
faculties were receptive to studying these treatments, the climate 
for receptivity to new information and techniques has been estab- 
lished not only among faculty members but also among the adminis- 
trative personnel of the two developing colleges. It is recommend- 
ed that the in-service program be continued and that the treatment 
be more specific through the use of more thoroughly developed ma- 
terials . 



INTRODUCTION 



The cultural lag in the South has created crucial educational 
needs demanding rapid development of higher education institutions 
and revision of past educational practices. Lane College and Freed- 
llardeman College are two developing institutions in West Tennessee 
trying to meet these needs with expanding programs. Their plans 
demand an increase in faculty skills, including those of a research 
nature , 

In these developing institutions the possession of limited 
funds presents difficulties in the recruiting of faculty to meet 
institutional desires and needs. The main route to expansion in 
research activities taken by these colleges is to develop research 
competencies in their present faculty members. In-service exper- 
iences are needed to aid faculty members in developing not only 
their potential as research personnel but also their ability in in- 
structional processes and skills. 



Development of a continuing in-service program, however, needs 
research- oriented personnel and released faculty time that can be 
ill-afforded by these colleges. Although both in-service programs 
and programs designed to develop research personnel are crucial to 
these institutions, attempted development is not practical without 
outside support. 

As part of an accelerated growth pattern, Memphis State Uni- 
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varsity is participating actively in developing an educational re- 
search program. Several of its projects involve programs with in- 
stitutions in the Mid- South area. This program, begun in August, 
1966, with a grant from the U.S. Office to establish an undergrad- 
uate research training program, now includes a permanent full-time 
staff who assure the continued development of a maturing program 
in research activity. The West Tennessee Research Development Con- 
sortium seeks: (1) to develop research competencies of potential 

researchers on the campuses of the two colleges through the conduct 
of a cooperative research venture and through research training; 

(2) to expose the staffs and students of each of these colleges to 
Opportunities to observe and participate in an on-going research 
project; (3) to demonstrate the importance of research to develop- 
ing institutions as a field of endeavor, as a decision-making in- 
strument, and as an instructional method; (4) to develop curricu- 
lum materials which will aid in the maintenance quality of instruc- 
tion in developing institutions through in-service programs; (5) 
to study the treatment effects of curriculum packets designed to 
upgrade instructional processes in higher education, a need vir- 
tually unattended, and (6) to offer laboratory experiences for re- 
search training students at Memphis State University, 

METHODS 

A faculty seminar (composed of eight faculty members selected 
by each college’s administration) met two hours every two weeks at 
each college during the 1968-69 academic year* The faculty was 
made familiar with the selected criteria instruments (the Stanford 
Teacher Competence Appraisal Guide and the Purdue Rating Scale for 
Instruction). They were made aware that: (1) there were no local 

norms on these instruments; (2) there was no attempt to compare 
faculty ability; (3) ratings of instructional approaches by indi- 
vidual faculty personnel in each group were to be held confidential 
and returned to each faculty participant upon his request, other- 
wise individual ratings were made unidentifiable in the calculation 
of group means; (4) students in the classes of each faculty member 
provided the ratings on instructional procedures anonymously; and 
(5) ratings were used only to ascertain effectiveness of the treat- 
ments. After the first meeting, baseline ratings were made* 



A different treatment was administered to each group in a pre- 
test/post-test design during the first semester: 
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Time 



Group 1 



Group 2 



1st week 
3rd week 



Baseline Data Established, 
Test Construction Treat- 
ment Begun 



Orientation 



Baseline Data Established, 
Educational Media Treat- 
ment Begun 



Orientation 



13th week 
15th week 



Last Criteria Measurement 
Analysis , Interpretation 
and Discussion of Results 



Last Criteria Measurement 
Analysis , Interpretation 
and Discussion of Results 



During the second semester the treatments, (1) Test Construc- 
tion and (2) Educational Media, were exchanged between schools, 
providing an AB-BA comparison design* Approximately the same treat- 
ment was directed toward specific behavioral goals* 

The Educational Media treatment: was directed toward the im- 
provement of teaching through an understnading of the operation 
of audio-visual equipment and the utilization of it in actual class- 
room situations, the preparation of a variety of materials, and 
discussion of newly developing media concepts and related instruc- 
tional devices. During the seminars, the following topics were dis- 
cussed: the overhead projector and transparencies, the bulletin 

board, preparing 2 M x 2" slides, the filmstrip and slide projector, 
the tape recorder, and the 16 mm movie projector. 

The Test Construction treatment dealt with testing and evaluat- 
ing as part of the learning process, behavioral objectives, validity 
and reliability, types of testing, and objective testing. Four 
major objectives underlay the unit: improvement in test design, 

item selection, unit design, and differentiated testing. 

FINDINGS AND ANALYSIS 



The Educational Media treatment was studied during the first 
semester by the Lane College faculty members, during the second 
semester by teachers at Freed-Hardeman College, Two types of analy- 
ses were made on the pre- test/post- test ratings given the teachers 
by students on two rating instruments (twenty selected items of the 
Purdue Scale, and the Stanford Guide): (1) t-tests on items on each 

of the scales, and on teachers in the groups; and (2) difference 
score matrices on items and teachers. The t- tests were made in order 
to ascertain if there were any significant differences in the treat- 
ment; the difference score matrices were constructed in order to 
see how individual members changed and on what items. 



The Educational Media Treatment 
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T- tests . Tables 1 and 2 record analyses made upon items on 
the rating scales for the Lane College teachers* Table 1 shows 
that there were no significant differences between the pre-test/ 
post- test ratings except on two items of the Purdue Seale; both 
were negatively significant* In contrast. Table 2 reveals a neg- 
ative significance on ten items on the Stanford Scale. For Freed- 
Hardeman teachers. Table 3 records no items with significant dif- 
ferences on the Purdue Scale except for one which is negatively 
significant. Table 4 shows no significant differences on the 
Stanford Scale except for two items, both positively significant. 

Tables 5 and 6 indicate analyses made upon Lane College fa- 
culty on the two rating scales. Table 5 shows that there were 
six teachers who registered significant scores, three of which were 
of negative significance - one severly so - on the Purdue Scale. 
Table 6, a record of t- value scores on the Stanford Guide, has 
four negative t- values, ^wo extremely so, of six significant scores. 

Tables 7 and 8 disclose analyses on Freed- Hardeman faculty 
on the two rating scales. Table 7 shows an equal distribution of 
the six significant t- values, three negative and three positive, 
on the Purdue Scale. Table 8 tells that on the Stanford Guide 
all t- values were of significance, with five being positive. 

Difference Score Matrices . Table 9 reveals that there was 
a differential effect or reception of the Educational Media treat- 
ment by the Lane College faculty on the difference score matrix on 
the Purdue Scale. There was one item mean increase and three teach- 
er mean increases. The differential effect repeated on the Stan- 
ford Guide: Table 10 shews that there were three individuals whose 

means increased but there was not an item mean increase despite 
positive individual improvement. 



On the same treatment involving Freed-Hardeman faculty. Table 
11 reports that, on the difference score matrix on the Purdue Scale, 
three item means increased while three individual means increased* 
Table 12 indicates that on the Stanford Guide there were increases 
on all item means and that five of the eight teachers sustained in- 
creases on individual means. Again, a differential effect was pre- 
sent . 

The Test Construction Treatment 



The Test Construction treatment was studied during the first 
semester by Freed^Hardeman College faculty members, during the sec- 
ond semester by teachers at Lane College. Analyses of data paral- 
leled that made on the other treatment; (1) t- tests on items on 

6 




13 



TABLE 1 



Comparison of Pre- test /Post- test Scores of Lane College Teachers 
Using T- test on Items of the Purdue Rating Scale for Instruction^ 

Fall Semes ter 5 1968 



Item 


t^ value 


df 


Signif ieanci 


Interest in Subject 


-0,77 


7 


ns 


Sympathetic Attitude Toward Students 


-1,73 


7 


,10 


Fairness in Grading 


0,27 


7 


ns 


Liberal and Progressive Attitude 


-0,81 


7 


ns 


Presentation of Subject Matter 


-1.26 


7 


ns 


Sense of Proportion and Humor 


-1.03 


7 


ns 


Self-Reliance and Confidence 


-0.10 


7 


ns 


Personal Pecularities 


-0.78 


7 


ns 


Personal Appearance 


-2.54 


7 


,05 


Stimulating Intellectual Curiosity 


1.22 


7 


ns 



Levels; p < , 10 
P < .05 
P < .01 



t > 1,415 
t > 1,895 
t ^ 2,998 



^Scores were mean student ratings of each Lane College teacher 
during the first semester. 



TABLE 2 



Comparison o£ Pre- test /Post- test Scores of Lane College Teachers 
Using T“ r.e s t on Items of the Stanford Teacher Competence Appraisal 

Guide* 

Fall Semester. 1968 



Item 

Clarity of Aims 

Appropriateness of Aims 

Organization of Lesson 

Selection of Content 

Selection of Materials 

Beginning the Lesson 

Clarity of Presentation 

Pacing of the Lesson 

Pupil Participation and 
Attention 

Ending the Lesson 

Teacher-* Pupil Rapport 

Variety of Evaluative 
Procedures 

Use of Evaluation to Improve 
Teaching and Learning 



t- value 


d£ 


Significance 


-1,78 


7 


.10 


-1.62 


7 


.10 


-1.11 


7 


ns 


-1.81 


7 


.10 


-1.47 


7 


.10 


-2.55 


7 


.05 


-2.14 


7 


.05 


-2.38 


7 


.05 


-2.32 


7 


.05 


-1.36 


7 


us 


-1.32 


7 


ns 


-1.74 


7 


.10 


-1.83 


7 


.10 



Levels : p 


< .10 


t 


> 


1.415 


P 


< .05 


t 


> 


1.895 


P 


C .01 


t 


> 


2,998 



^Scores were mean student ratings of each Lane College teacher 
during the first semester. 




TABLE 3 



Comparison of Pre- test/Post^ test Scores of Freed- Hardeman College 
Teachers Using T-test on Items of the Purdue Rating Scale for 

Instruction^ 

Spring Semester, 1969 



Item 

Interest in Subject 

Sympathetic Attitude Toward 
Students 

Fairness in Grading 

Liberal and Progressive Attitude 

Presentation of Subject Matter 

Sense of Proportion and Humor 

Self-Reliance and Confidence 

Personal Pecularities 

Personal Appearance 

Stimulating Intellectual Curiosity 



:- value 


df 


Significance 


-1.13 


7 


ns 


-1.24 


7 


ns 


1.20 


7 


ns 


0.26 


7 


ns 


0.04 


7 


ns 


0.71 


7 


ns 


-0.46 


7 


ns 


-0.92 


7 


ns 


-2.09 


7 


.05 


-1.17 


7 


ns 



Levels : 



P 


< .10 


t 


> 


1.415 


P 


< .05 


t 


> 


1.895 


P 


^ .01 


£ 




2.998 



★Scores x?ere mean student ratings of each Freed- Hardeman College 
teacher during the second semester* 



TABLE 4 



Comparison of Pre- test /Post- cast Scores of Freed-Hardeman College 
Teachers Using T- test on Items of the Stanford Teacher Competence 

Appraisal Guide* 


Spring Semester 5 


1969 






Item 


- va lua 


df 


Significance 


Clarity of Aims 


1,36 


7 


ns 


Appropriateness of Aims 


0,53 


7 


ns 


Organisation of Lesson 


1.76 


7 


• 10 


Selection of Content 


1.36 


7 


ns 


Selection of Materials 


0,32 


7 


ns 


Beginning the Lesson 


0.55 


7 


ns 


Clarity of Presentation 


0.60 


7 


ns 


Pacing of the Lesson 


1,66 


7 


.10 


Pupil Participation and 
Attention 


1,39 


7 


ns 


Ending the Lesson 


1.15 


y 


ns 


Teacher- Pupil Rapport 


1.2“ 


1 


ns 


Variety of Evaluative 
Procedures 


0,16 


7 


ns 


Use of Evaluation to Improve 
Teaching and Learning 


1,10 


7 


ns 



Levels; p < ,10 t 1.415 

P < ,05 t p 1.895 

p < .01 t > 2.998 

*$cores were mean student ratings of each Freed- Hardeman College 

teacher during the second semester, 

10 
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TABLE 5 



T-test on Lane College Faculty by Comparing 
Pre-Test/Post-Test Scores on the Purdue 
Rating Scale for Instruction* * 



Fall 

Faculty 

Member 

01 

04 

06 

09 

10 
11 

13 

14 



Semester, 1968 

t- value 
3.12 
1.85 
-7,86 
3,31 
-3.37 
-0.33 
-0.32 
-1.84 



df S ignif Icanee 
9 ,01 

9 .05 

9 ,01 

9 .01 

9 . 01 , 

9 ns 

9 ns 

9 ,05 



Level: p < .10 

P < -°5 

p < ,01 



t > 1.383 
t y 1.833 
t > 2.821 



*Scores were mean student ratings of each Lane College teacher 
during the first semester. 
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TABLE 6 



T- test on Lane College Faculty by Comparing 
Pre-Test/Post-Test Scores on the Stanford 
Teacher Competence Appraisal Guide* * 

Fall Semester* 1968 



Faculty 



Member 


£- value 


df 


Significance 


01 


2.37 


12 


.05 


04 


1.74 


12 


.10 


06 


-16.63 


12 


.01 


09 


-4.17 


12 


.01 


10 


-10.36 


12 


.01 


11 


0.75 


12 


ns 


13 


-3.87 


12 


.01 


14 


-0.33 


12 


ns 



Level; p < .10 t > 1,356 

P < .05 t > 1.782 

P < .01 t > 2.681 

*3eores were mean student ratings of each Lane College teacher 
during the first semester. 
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TABLE 7 



T-test on Freed-Hardeman College Faculty 
by Comparing Pre-Test/Post-Test Scores on 
the Purdue Rating Scale for Instruction* * 

Spring Semester, 1969 

Faculty 

Membef t-value df Sienifi< 


51 ! 


-1.02 


9 


ns 


52 


-0-35 


9 


ns 


54 


2.68 


9 


,05 


56 


1.76 


9 


.10 


58 


-3,58 


9 


.01 


59 


-1.84 


9 


.05 


60 


-4.98 


9 


.01 


61 


4.97 


9 


.01 



Level: p < ,10 

P < »05 
P < »oi 



t > 1,383 
t > 1,833 
t > 2.821 



*Scores were mean student ratings of each Freed-Hardeman 
teacher during the second semester. 
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TABLE 8 



T- test on Freed- Hardeman College Faculty by Comparing 
Pre-Test/Post-Test Scores on the Stanford 
Teacher Competence Appraisal Guide'* 

Spring Semester, 1969 



Faculty 

Member 


t-* value 


df 


Signifi 


51 


-2.12 


,12 


,05 


52 


4,39 


12 


,01 


54 


5.70 


12 


.01 


56 


2,97 


12 


.01 


58 


2,76 


12 


.01 


59 


-2,50 


12 


,05 


60 


-3,43 


12 


.01 


61 


5.87 


12 


,01 



Level: p 


< .10 


t > 


1.356 


P 


< .05 


t > 


1.782 


P 


< .01 




2.681 



^Scores were mean student ratings of each Freed 'Hardeman 
teachers during the second semester. 
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TABLE 9 



Difference Scores Matrix for the Purdue 
Rating Scale for Instruction for Lane College* 

Fall Semester 5 1968 



'Teacher ! 

! i 


1 

i 

c- — 


2 


1 3 

L == 


4 


5 


6 


7 


a 


9 


10 


! 

Mean 


1 ) 
; oi i 

: i 


4 — 

i 


- 


1 

j 


1 

i 

j + 

i 


4 


4- 




4- 


4 


4 


4* 


| 04 ! 

j 


+ 


- 


i 

1 4 


i + 

j 


- 


- 


4- 


+ 


- 


4- 


+ 


1 

: 06 

i 


- 






i 

1 


~ 


- 


- 


- 






- 


09 


+ 


4= 




4= 


4 


4 


4 


- 


4 


■ . 

4 


* 


10 


+ 


- 


- 


- 


- 


- 


- 


- 




“ 


- 


11 


4 - 




- 


4 


- 


- 


4 


4- 


0 


~ 


- 


13 


- 


- 


4- 


“ 


4 


4- 


4- 


4- 


- 


4- 


- 


14 


- 


- 


- 


- 


4 


- 


- 


- 


- 


4- 


' 


























I lean 


- 


- 


- 


- 


- 


; 


0 


- 




4 


- 



*Differenee scores were formed by subtracting pre-test mean student 
ratings from post-test student ratings of each Lane College teacher 
during the first semester. The + ? s, -'s, and 0’s reported indicate 
increase, decrease, and no change, respectively, from pre— test to 
post- test. 
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TABLE 10 

Difference Scores Matrix For the Stanford Teacher 
Competence Appraisal Guide for Lane College* 

Fall Semester, I960 



Teacher 


1 


2 


3 


4 


5 


6 


i 

7 


8 


9 


10 


ii 


12 


13 


Mean 


01 


4 


4 


-l 

l 


4 


4 


“ 


4 


- 


4 


- 


4 


4 


4 


4 


04 


4* 


4 


i 


4 


4 


- 


- 


4 


- 


4 


4 


- 


4 


4 


06 


- : 


- 


- 


- 


- 




' - 


- 


“ 


- 


- 


- 


— 


- 


09 


- 


- 


- 


- : 


- 


- 


- • 


- 


- 


- 


- 


- 


- \ 


tr 

: & 


10 


- 


-- 


- 


■ - 


- 


- 


- 


- 


- 


- 


- 


4 


- 


- 


11 


4 


- 


4 


- 


4 


- 


- 


- 


- 


4 


4 


4 


4 


4 


13 


- 


- 


- 


- 


- 


- 


4 


- 


- 


- 


4 


- 


- 


- 


14 


4 


4 


4 


4 


- 


- 


- 


- 


- 


4 


- 


- 


- 


- 
































Mean 

. 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 



*Dif ference scores were formed by subtracting pre-test mean student 
ratings from post-test ratings of each Lane College teacher during 
the first semester. The 4 f s and “ f s reported indicate increase or 
decrease, respectively, from pre-test to post-test, 
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TABLE 11 



Difference Scores Matrix for the Purdue Rating 
Scale for Instruction for Freed- Hardeman College* 



Spring Semester 9 1969 



Teacher 


i 


i | 

2 ! 3 ! 4 
1 — 


5 


6 


1 

! 7 


3 


9 


10 


j 

| Hean 


51 


i 

1 


[— : 

1 - • + 
i i m 


! 


4- 


4- 


- 


- 




- 


52 


- 


+ j + 1 - 
! | 


- 


+ 




+ 


- 


i 




54 


! 


- — ■ • " - 

4* j 

j 


! + 

j 


4- 


4- 


4- 


4* 


4* 


+ 


+ 


56 


1 

+ 




+ 


♦ 

i 


- 


+ 


1 + 

| 


+ 


+ 


- 


4- 


58 


- 


+ 


4- 




- 


- 


i 


- 


- 


- 


- 


59 


0 


1 


~ — ' 


+ 


- 


i 

+ 


i 


0 


- 


4- 


- 


60 




- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


61 




- 


+ 




4“ 


+ 


4- 


4- 


0 


4- 


+ 


























Mean 




- 


+ 

I 


+ 


- 


+ 




- 




- 


- 



^Difference scores were formed by subtracting pre-test mean student 
ratings from post-test ratings of each Freed-Hardeman College teacher 
during the second semester. The 4- f s and — 7 s recorded indicate increase 
or decrease p respectively 9 from pre-test to post-test; 0*s indicate no change. 
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TABLE 12 



Difference Scores Matrix for the Stanford Teacher 
Competence Appraisal Guide for Freed-Har deman College- 

Spring Semester , 1969 



Teacher 


i 


2 


3 


4 


5 


6 


7 


8 


9 


10 


ii 


12 


13 


Mean 


1 


51 


- 


- 


- ; 


- 


- 


- 


4 


4 


4 


“ 


- 


- 


- 


- 




52 


4 


4- 


» 

r 


4 


4 


4 


4 


4 


“ 


4 


4 




4 


4 




i 

54 


- 


4 


4 

t 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


56 


4 


+ ! 


i , 

■ T 
| 


4 


4 


0 


4 


4 


4 


4 


4 


- 


| + 

I 

i 


4 


58 


4 


4 


4 


4 


4 


- 


- 


4 


4 


& 


4 


4 


4 


4 


59 


0 


- 


- 


- 


- 


- 


- 


4 


... 


4 


- 


- 


4 


- 


60 


- 


- 


- 




- 


- 


- 


- 


4 


“ i 


; - 


- 


4 


- 


61 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


Mean 


4 

1 i 


+ 

! 


4 


4 


4 


+ 


4 


4 . 

1 


4 


4 


4 


4 


4 


4 



^Difference scores were formed by subtracting pre-test mean student 
ratings from post-test ratings of each Freed-Hardeman College teacher 
during the second semester. The + ’s, -'s, and 0's recorded indicate 
increase, decrease, or no change, respectively, from pre-test to post-test. 
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each of the scales, and on teachers in the groups; and (2) differ- 
ence score matrices. Additionally, a pre-test and post- test, de- 
signed by the consultant, was given each faculty member over the 
Test Construction treatment, 

T- tests . Tables 13 and 14 show the analyses of the Freed- 
Hardeman College teachers on items on the rating scales. Table 
13 records that negative significance was found on the Purdue Scale 
on nine items, no significant difference on the remaining eleven. 
Table 14 points out that there were no significant differences on 
eight items on the Stanford Guide, negative significance on the 
remaining five. Tables 15 and 16 disclose the analyses of the Lane 
College faculty on items on the rating scales. Table 15 has no 
significant differences on f if teecn of the twenty items on the Fur- 
due Scale, negative significance on the five others. Table 16 
shows no significant differences on items on the Stanford Guide. 

Tables 17 and 18 depict t-values made on F-H College faculty 
on the two rating scales. Table 17 shows that on the Purdue Scale 
the t-vaiues of all faculty members are of significance over the 
first ten items of the scale, all but one being negative. On items 
11-20 significance was discovered on the t-values of six of the 
eight teachers, four of these being negative. Table 18 shows that 
on the Stanford Guide, seven of eight faculty t- values were found 
to be significant, six of which were negative. 

Tables 19 and 20 disclose analyses made on all the Lane Col- 
lege faculty on the same scales. On 19, five teachers have t- values 
of significance over the first ten items of the Purdue Scale; four 
of these were negative scores, one extremely so. Over items 11-20 
on the Purdue Scale, five faculty achieved t- values of significance, 
three of which were positive, one extremely so* Table 20 reveals 
that on the Stanford Scale six faculty t- values were of signifi- 
cance, four of which were positive* In general, there was a dif- 
ferential effect over the treatments on the two scales. 

Difference Score Matrices ^ Table 21 shows the difference 
score matrix computed for the Freed-Hardeman College group on the 
Test Construction treatment during the first semester. The group 
means increased on only one item of the first ten and cn four of 
the next ten, items dealing specifically with testing. One faculty 
member had a mean increase on the two portions of the scale, while 
one other had an increase on the last ten items. Table 22, the 
matrix of the Freed-Hardeman group for the Stanford Guide, shows a 
scattering of increases among six members of the group with three 
item mean increases and two faculty mean increases. This indicates 
a differential effect for this group, 
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TABLE 13 



Comparison of Pre- Test/Post- Test Scores of 


Freed 


-Hardeman 


College Teachers. Using. T- 
Purdue Rating Scale 


test- on Items of 
for Instruction* 


the 


Fall Semester ? 1968 






Item 


t- value 


d£ 


Significance 


Interest in Subject 


-3.50 


7 


.01 


Sympathetic Attitude Toward Students -3.24 


7 


.01 


Fairness in Grading 


-0.28 


7 


ns 


Liberal and Progressive Attitude 


-1.27 


7 


ns 


Presentation of Subject Matter 


-2.19 


7 


.05 


Sense of Proportion and Humor 


-1.66 


7 


.10 


Self-Reliance and Confidence 


-1.05 


7 


ns 


Personal Pecu lari ties 


-2,12 


7 


.05 


Personal Appearance 


-2.07 


7 


.05 


Stimulating Intellectual Curiosity 


-2.41 


7 


.05 


Suitability of Methods 


-1.62 


7 


*10 


Degree Objectives Clarified and 
Discussed 


-0.89 


7 


ns 


Agreement Between Announced Objec- 
tives and Those Taught 


-0.70 


7 


ns 


Use of Tests as Learning Aids 


-0.75 


7 


ns 


Student Freedom in Selecting Materials- 1 .33 


7 


ns 


How Course Fulfills Needs 


-1.79 


7 


.10 


Weight Grade Given to Tests in 
Determining Final Grade 


-0,79 


7 


ns 


Test-Major Objectives Coordination 


-0,40 


7 


ns 


Frequency of Tests 


-1.47 


7 


ns 


Overall Rating of Instructor 


-1.15 


7 


ns 


Levels: p < ,10 t .> 1,415 

p < .05 t 1.895 

p < .01 t ■> 2.998 








^Scores were mean student ratings of 
teacher during the first semester. 
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TAB ! E 14 



Comparison of Pre- test/Post- test Scores of Freed- Hardeman College 
Teachers Using T-test on Items of the Stanford Teacher Competence 

Appraisal Guide* 

Fall Semester. 1968 



Item 

Clarity of Aims 

Appropriateness of Aims 

Organisation of Lesson 

Selection of Content 

Selection of Materials 

Beginning the Lesson 

Clarity of Presentation 

Pacing of the Lesson 

Pupil Participation and 
Attention 

Ending the Lesson 

Teacher- Pupil Rapport 

Variety of Evaluative 
Procedures 

Use of Evaluation to Improve 
Teaching and Learning 



t- value 


df 


Significance 


-1.61 


7 


.10 


-0.51 


7 


ns 


-1.19 


7 


ns 


-0.50 


7 


ns 


0. 33 


7 


ns 


1 

t— 1 

« 

*v] 

o 


7 


.10 


-2.11 


7 


,05 


-1.53 


7 


,10 


-1.28 


7 


ns 


-1.31 


7 


ns 


-1.18 


7 


ns 


-1.69 


7 


.10 


-0.15 


7 


ns 



Levels: p < ,10 

P < *05 
P < *01 



t > 1,415 
t > 1,895 
t y 2.998 



^Scores 

teacher 



were mean student ratings of 
during the first semester, 
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TABLE 15 



Comparison of Pre-Test/Posl-Test Scores of Lane College 
Teachers Using T- test on Items of the 
Purdue Rating Scale for Instruction* 

Spring Semesters 1969 



Item t= 


•value 


df 


Significance 


Interest in Subject 


-0.90 


7 


ns 


Sympathetic Attitude Toward Students 


-1.06 


7 


ns 


Fairness in Grading 


-0,96 


7 


ns 


Liberal and Progressive Attitude 


-1.73 


7 


,10 


Presentation of Subject Matter 


-1.41 


7 


.10 


Sense of Proportion and Humor 


-1,62 


7 


,10 


Self-Reliance and Confidence 


-0.82 


7 


ns 


Personal Peculiarities 


-1.60 


7 


,10 


Personal Appearance 


-0.98 


7 


ns 


Stimulating Intellectual Curiosity 


-1.70 


7 


.10 


Suitability of Methods 


0.58 


7 


ns 


Degree Objectives Clarified and 
Discussed 


0,37 


7 


ns 


Agreement Between Announced Objec- 
tives and Those Taught 


0,48 


7 


ns 


Use of Tests as Learning Aids 


-0.25 


7 


ns 


Student Freedom in Selecting Materials 


i 0.07 


7 


ns 


How Course Fulfills Needs 


-0,01 


7 


ns 


Weight Grade Given to Tests in 
Determining Final Grade 


-0.22 


7 


ns 


Test-Major Objectives Coordination 


0.11 


7 


ns 


Frequency of Tests 


0.79 


7 


ns 


Overall Rating of Instructor 


-0.59 


7 


ns 



Levels : p 


< .10 


t 


> 


1.415 


P 


< .05 


t 


» 


1.895 


P 


< .01 


t 


> 


2.998 



^Scores were mean student ratings of each Lane College teacher 
during the second semester, 
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TABLE 16 



Comparison of Pre~ test/Post- test Scores of Lane College Teachers 
Using T“test on Items of the Stanford Teacher Competence Appraisal 

Guide* 

Spring Semesterj 1969 



Item 

Clarity of Aims 

Appropriateness of Aims 

Organization of Lesson 

Selection of Content 

Selection of Materials 

Beginning the Lesson 

Clarity of Presentation 

Pacing of the Lesson 

pupil participation and 
Attention 

Ending the Lesson 

Teacher- Pupil Rapport 

Variety of Evaluative 
Procedures 

Use of Evaluation to Improve 
Teaching and Learning 



t- value 


df 


Significance 


0,27 


7 


ns 


0,53 


7 


ns 


-0,38 


7 


ns 


-0,12 


7 


ns 


1.26 


7 


ns 


0,32 


7 


ns 


-0,56 


7 


ns 


-0,92 


7 


ns 


0.07 


7 


ns 


-0.64 


7 


ns 


-0.03 


7 


ns 


-0.09 


7 


ns 


-0.74 


7 


ns 



Levels i p < ♦ 10 t > 1.415 

p ^ .05 f > 1.895 

p c .01 t > 2*998 

^Scores were mean student ratings of each Lane College teacher 
during the second semester. 
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TABLE 17 



T-tesfc on Freed-Hardeman Collage Faculty by Comparing 
Pre-Test /Post- Test Scores on the Purdue Eating 
Scale for Instruction* * 



Fall Semester, 1968 



Faculty 

Member t- value df S i gn i ficance 

Items 1- 10 



51 




-3.75 


9 


.01 


52 




-3.01 


9 


,01 


54 




-1.83 


9 


.05 


56 




2.74 


9 


.05 


58 




-6.57 


9 


.01 


59 




-5,19 


9 


,01 


60 




-2.76 


9 


.05 


61 


Items 11-20 


-2.49 


9 


.05 


51 




-5.72 


9 


.01 


52 




-6.98 


9 


.01 


54 




-0.58 


9 


ns 


56 




5.61 


9 


.01 


58 




-0.13 


9 


ns 


59 




3.89 


9 


.01 


60 




-2.40 


9 


,05 


61 




-6.87 


9 


.01 




Levels p ^ .10 
P < .05 
P < .01 



t > 1,383 
t > 1,833 
t ^ 2.821 



*Scores were mean student ratings of each Freed-Hardeman 
teacher during the first semester, 
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TABLE 18 



T-test on Freed-Hardeman College Faculty by Comparing 
Pre-Test /Post- Test Scores on the Stanford Teacher 
Competence Appraisal Guide* 



Fall Semester, 1968 



Faculty 

Member 


t- value 


df 


Signif i 


51 


-0.85 


12 


ns 


52 


-4.40 


12 


.01 


54 


-3.61 


12 


„Q1 


56 


9.30 


12 


.01 


58 


-5.73 


12 


.01 


59 


-1.52 


12 


.10 


60 


-1,43 


12 


.10 


61 


-6.31 


12 


.01 



Level : p 


< .10 


t 


> 


1.356 


P 


< .05 


t 


> 


1.782 


P 


< .01 


t 


> 


2.681 



^Scores were mean student ratings of each Freed-Hardeman College 
teacher during the first semester. 
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TABIZ 19 



T- test on Lane College Faculty by Comparing 
Pre- Test/Post- Test Scores on the Purdue 
Rating Scale for Instruction* 





Spring Semes ter * 1969 






Faculty 

Member 




t- value 


df 


S ignif icance 


01 


Items 1-1.0 


4.20 


9 


.01 


06 




0.34 


9 


ns 


09 




-9.83 


9 


.01 


10 




-4.24 


9 


.01 


11 




-3,15 


9 


.01 


12 




0.67 


9 


ns 


13 




-5.52 


9 


.01 


14 




-0.08 


9 


ns 


01 


Items 11-20 


1.82 


9 


.10 


06 




0.91 


9 


ns 


09 




-2.77 


9 


.05 


10 




-5.77 


9 


.01 


11 




1.26 


9 


ns 


12 




1.71 


9 


.10 


13 




0.06 


9 


ns 


14 




8.43 


9 


.01 



Leva 1 : p 


< .10 


t 


> 


1,383 


P 


< .05 


t 


> 


1.833 


P 


< .01 


t 


> 


2.821 



ERIC 



*Seores were mean student ratings of each Lane College teacher 
during the second semester. 
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TABLE 20 



T- test on Lane College Faculty by Comparing 
Pre-Test /Post- Test Scores on the 
Stanford Teacher Competence Appraisal Guide** 

Spring Semester, 1969 

Faculty 

Member t- value d£ Signifi< 


01 


3.14 


12 


.01 


06 


-1.20 


12 


ns 


09 


0.96 


12 


ns 


10 


-5.87 


12 


.01 


11 


-3.99 


12 


.01 


12 


4.56 


12 


. i 


13 


1.65 


12 


.10 


14 


4.69 


12 


.01 



Le ve 1 : p 


< .10 


P 


< .05 


P 


< .01 



t> 1.3S6 
t > 1,782 
l: > 2.681 



*Scores were mean student ratings of each Lane College Teacher 
during the second semester. 
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Difference Scores Ilatrix for the Purdue 
Rating Scale for Instruction for Freed-Hardeman College' 



TABLE 22 



Difference Scores Matrix for the Stanford Teacher 
Competence Appraisal Guide for Free d -Mia rd email College'' 

Fall Semester* I960 



1 

Teacher 


1 


2 


3 


4 


5 j 


!« 


7 


3 


9 


10 


11 


\ 

i 

12 , 


13 


I-Iean 


51 


+ 


+ 


- 


4- 


+ 


4- 


- 




4- 


, 


- 


- 


+ 


4- 


52 


- | 


- 




- 


0 


- 




- 




- - - - - 


4- 


- 




*- 


54 


- 


+ 


“ 


- 


- 


- 


- 


0 


■ 


r 


- 


■ - 


- L 


- 


56 


+ 


+ 


4- 




4- 


- 


4“ 


4- 


4- 


JU 

f 


4- 


4* 


l 

[h 


4- 


58 


- i 


- 


- 


- 


- 


- 


1 


- 


- 


j 


- 


- 


i 


- 


59 


-- ! 


- 


4“ 


- 


- 


- 


- 


4- 


4* 


! - 




“ 


- 


- 


60 




- 


+ 


- 


4“ 


- 


- 


- 


- 


- 


- 


i 


4- 


- 


61 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


Mean 


i 


4- ■ 


0 


- 


4= 


- 


- 


- 




; ' ' 


- 


- 


4® 


- 



^Difference scores were formed by subtracting pre-test mean student 
ratings from post-test ratings of each Freed-Hardeman College teacher 
during the first semester. The + 3 s 5 - 5 s 5 and 0*3 reported indicate 
increase decrease* or no change* respectively* from pre-test to post-test. 
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During the second semester the Lane College faculty studied 
the Test Construction treatment. The matrix on the Purdue Seale, 
Table 23* relates that there were no item mean increases on the 
first ten items of the scale but that there were six item mean in- 
creases on items XX-2Q, that portion of the scale dealing with 
testing. Three teachers had mean increases on the first portion, 
four on the second portion of the scale. Again, a differential 
effect was evident* Table 24, the matrix for the Stanford Guide, 
indicates improvement among seven individuals while one person 
showed a severely negative change. There were increases on six 
item means and on the means of five individuals, a further indi- 
cation of a differential effect. 

Pre- test /Post- test . The criterion test was given before and 
after the Test Construction treatment, at Freed-Hardeman College 
during the fall semester and at Lane College during the spring 
semester. Table 25 indicates that seven Freed- Hardeman College 
participants scored an average of 11 . 0 points on the pre-test and 
18.4 points on the post- test for an increase of ,7.4 points per 
teacher* Table 26 reveals that the eight members of the Lane Col- 
lege group scored an average of 10.4 points on the pre-test and 
16.6 points on the post- test for an average increase of 6.2 points 
per teacher « 



Frequency of Significant T- Value Scores 

Another method of analyzing the data is presented in Tables 
27 and 28 which depict the frequency of t- value scores (on items 
and on teachers) which were either negatively or positively sig- 
nificant* Because of the inconsistency of the results it is not 
practical to draw clear-cut arid genera X .zable conclusions about the 
data , 

CONCLUSIONS and recommendations 

There exist many instances of significant differences in the 
two rating scales, many of them negative values. This could be 
influenced by an inadequate treatment basis, contamination of the 
data, improved rater perception, or because of the relationship be- 
tween the treatment and the rating scales used to gather student 
reaction to faculty members. 

Although the results indicate that the instruc tional treat- 
ments made a noticeable negative difference there is adequate rea- 
son to continue the application of methodologies because a need 
exists for the constant in-service training of instructors in in- 
stitutions of higher learning. Such training has long range results 
not immediately seen in class performances. There is also a crucial 
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TABLE 23 

Difference Scores Matrix for the Purdue Rating Scale 
for Instruction for Lane College* 
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* Difference scores were formed by subtracting pre-test mean student ratings from 
post- test ratings of each Lane College teacher during the second semester. The 

+'s, - 's, and 0's indicate increase, decrease, or no change, respectively, from 
pre-test to post- test. 



TABLE 24 



Difference Scores Matrix for the Stanford Teacher 
Competence Appraisal Guide for Lane College* 



Spring Semester 3 1969 
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^Difference scores were formed by subtracting pre-test mean student 
ratings f r on post-test ratings of each Lane College teacher during the 
second semester P The 4's - r s , and 0 f s recorded indicate increase ? 
decrease, or no change 9 respectively^ from pre-test to post-test, 
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TABLE 25 



Comparison of Pre-Test /Post- Test Scores 
o£ Preed-Hardeman College Faculty on 
the Test Construction Treatment* 



Fall Semester, 1968 
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Total points scored:: 77 

Mean: 11*0 




Mean: 18.4 



y Only seven in group at time of pre-test 

^Possible total points for each test (pre-test and post- test): 168 



x Indicates incorrect answers 



Total points post- test: 
Total points pre-test: 

I :Rir ain ? 

1 i V l - veraee gain per teacher: 



129 

77 

”52 

7,43 
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TABLE 26 



Comparison of Pre-test/Post-test Scores of 
Lane College Faculty on the 
Test Construction Treatment* 



Spring Semester * 1969 





Total points post-test 133 

Total points pre-test 83 

“50 41 

ERiC iraSe ga ^ n per teac her:6,25 
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TABLE 27 



Comparison of Frequency of Significant T- Value Scores 
of the Faculty of Lane College and Freed-Hardeman 
College on Items of the Purdue Rating Scale for 
Instruction and on the Stanford Teacher Competence 
Appraisal Guide, 1967-1969 
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LANE COLIEGE 
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1 1968-69 
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2 negative 
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10 negative 


Spring 
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5 negative** 


Test Construction 
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*Based on twenty items. 
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TABLE 28 



Frequency of Significant T-Value Scores of Teachers of Freed- Hardeman 
College and Lane College on the Purdue Rating Scale For 
Instruction and the Stanford Teacher Competence 
Appraisal Guide, 1968-1969 



FREED- HARDEMAN COLLEGE 



Purdue Scale 


Treatment 


Stanford Scale 


Semester 


Number of 

Significant Teachers 




Semester 


Number of 

Significant Teachers 


Fall 


Items 1- 10 
8 1 positive 

1 negative 
Items 11-20 
6 2 positive 

4 negative 


Test Construction 
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7 1 positive 

6 negative 


Spring 


6 3 positive 

3 negative 


Educational Media 


Spring 


8 5 positive 

3 negative 



LANE COLLEGE 



Purdue Scale 


Treatment 


Stanford Scale 


Semester 


Number of 

Significant Teachers 




Semester 


Number of 

Significant Teachers 


Fall 


6 3 positive 

3 negative 


Educational Media 


Fall 


6 2 positive 

4 negative 


Spring 


Items 1- 10 
5 1 positive 

4 negative 
Items 11-20 
5 3 positive 

2 negative 


Test Construction 


Spring 


6 4 positive 

2 negative 
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need for the training of research personnel in developing colleges. 
The continuance of a program of this nature should raise the proba- 
bility that a high quality of instructional research will take place 
on these campuses to improve instructional production. The benefits 
of a long range program are most ardent in the development of ade- 
quately trained personnel to carry out instructional research* the 
increased interest of faculty members to participate in research* 
and the development of a structure through which research can take 
place, 

A revision of treatment for the third year T s program will cen- 
ter around making the instructional treatment segments more specific 
in order to secure more significant results. The instructional treat- 
ment will focus upon a topic not generally studied by faculty members 
of higher educational institutions, A major problem with the two in- 
structional treatments that were given during the 1968-69 program cen- 
tered on two topics with which faculty members were familiar. The 
choice was considered sound because the basic strategy for both years 
of the Consortium was to revitalise an interest in already used teach** 
ing techniques and thereby create a climate of acceptance for treat- 
ments related to newly emerging knowledge. 

It is recommended that an additional year be given to this pro- 
gram during which the writing of Instructional objectives would be 
studied by both groups during the fall semester. The selection of 
instructional objectives helps determine the quality of courses taught 
in colleges and universities. Bloom 1 s Taxonomy will be used as a 
classification method for ascertaining the psychological dimensions 
of these objectives. The mic»-teaeh±Ag procedure would again be used 
as an instructional technique to establish communication levels and 
realistic eia&sroom objectives. 

During the second semester* the three-year program and its im- 
plications to the developing Institutions will be the primary focus 
and contribution. Three conferences will be held to deal with in- 
structional processes* research processes* and program implications. 
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APPENDIX A 



TEST CONSTRUCTION TREATMENT 
AND CRITERION 
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INTRODUCTION 



Objectives : 

This unit on testing and evaluation has underlying it four major objec- 
tives : if they are realized y the quality of testing should improve in the 
fo Honing areas : 

I. Test design. Teachers using this unit should be able to design three tynes 
of tests: 

A. Performance Tests 

B. Essay Tests 

C* Objective Tests 

II. Item selection. Teachers using this unit should be able to appraise a 
given body of material and select: 

A. The appropriate type of test 

B„ The appropriate type of items for valid and reliable testing 

III, Unit design for good evaluation# Teachers using this unit should be able 
to form units which lead to suitable tests in terms of: 

A. Stating behavioral objectives 

B. Establishing performances to determine satisfactory completion of learn- 
ing tasks 

C. Drawing straight line relationships between objectives of the course and 
testing items 

IV. Differentiated testing. Teachers using this unit should be able to identify 
and define the differences between testing for information (subject matter) 
and processes. 



Resources : 

Books: Bloom, B. Taxonomy of Educational Objectives . 

Hager, E. Preparing Instructinnal Objectives . 

Audio-Visual: VIMCET Filmstrip on Evaluation (with audio tape) 



Unit Plan; 

This unit on testing is divided into eight lessons. The first lesson will 
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be a pretest.: the last lesson is a unit test. Therefore, the six intervening 
lessons will be" 

A- Testing and evaluation as part of the total learning process* In 
this phase, testing will be considered as part of the total experi- 
ence whereby one is said to have 'learned^ 5 and a special attempt will 
be made to establish the notion that good testing is an essential 
part of the learning process* 

B. Setting behavioral objectives. In this phase the overt behaviors 

which serve as vis able and measurable signs of learning will be con- 
sidered, with special attention to the statements and forms of object 
tives . 

C 9 The third phase will concentrate on two criteria for test evaluation- 
validity and reliability- In this phase 3 two relationships will be 
demonstrated * 

1) The relationship between objectives and test instrument (validity) 

2) The relationship between consistency of performance and the test 
instrument . 

Do In this lesson, the problem of appropriate type of test will be con- 
sidered. The advantages and disadvantages of each type of test will 
be discussed,., along with different forms for obtaining the same type 
of information. Genera! statements of validity and reliability for 
each form will also be given* 

Eo The fifth phase will be designing the objective test. Because an 
objective test can be one of the best evaluative instruments if 
properly structured , special attention should be given to proper test 
design in order to obtain maximum benefits from this type of test* 
Also, a process for evaluating the type of information in the test 
will be explained. 

F* Testing and the learner. Because no test ever exactly corresponds 
to the real 3 non-measure able learning that takes place in a given 
learning experience p this phase will discuss 5 in general terms* some 
of the psychological pitfalls inherent in the testing process and 
attempt to establish some alternatives to formal testing by which a 
learning experience can be evaluated. 

Assignment for meeting two 

List three objectives from a unit you are now teaching - Be as specific 
as possible* Then list five test questions designed to< ‘evaluate these ob- 
jectives. From that, try to deduce as many methods as possible which realize 
the objectives. 
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LESSON ONE 

TESTING AND EVALUATING AS PART OF THE LEARNING PROCESS 



Trans p irency On e 

Can you list four reasons for testing in addition to giving a grade? 
Overlay 



For each of the reasons stated below which you have on your paper 9 give 
yourself five points* 

1) To determine if the objectives of the course have been achieved (Or 
part has to be re- taught) 

2) To determine which methods have buen. most effective as teaching devices 

3) To give students a chance to express feedback or an opportunity to n use f 
their learning to demonstrate a process mastery 

4) To locate some areas of individual abilities , strengths and weaknesses 

And ? 

5) To establish some points of transition to a new unit 

6) To determine which of the ideas in the unit were most popular 

Transparency Two 



Read the objective stated below and the test of the objective belcw it* 

Why will the test fail to measure achievement in terms of the objective? 

Give two reasons* Give yourself ten points for each correct one* 

Object ; The objective of this lesson is to enable a student to recognize 
three death metaphors in a given poem by relating them to nature. 

Tes t : What metaphors in this poem pertain to death? 

Overlay 

1, The objective asks for a relationship (death metaphor and nature) 
Test only asks for simple re ognition. 

2. The question doesn ? t ask for a specific number or an explanation * 
Perhaps the students see other metaphors of death and nature which 
the instructor hasn 4 1 seen. By having a chance to write f he may have 
chance to express his own value on the poem. 
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Points to be established' 



1. Testing is related to total experience of the unity it is part of the 
learning experience and should evaluate the instructors the materials 
and the methods and the student* 

2. There is a definite relationship between objectives and evaluation* 

A test which embraces this relationship is a valid test. 

3. The methods used in the unit must have a lineal relationship to ob- 
jectives and tests. For instance* 

Suppose that you wanted to teach a student to change a tire on a car s and 
that you had gone through all of the steps in this form, without pictures 
or any illustrative material* 

a) Get handbrake 

b) Take jack out of trunk and jack up ear 

c) Remove hub caps 

d) Loosen lugs and remove flat tire 

e) Remove lugs from wheel 

f) Take spare from trunk and place on lug bolts 

g) Tighten down lugs ? replace hub cap 

h) Place flat in trunks jack down car 

i) Release brake , drive away 

What are the chances that the student, actually confronted with a car as 
a test, could successfully change the tire? The methods were not in line 
with the objective and the test. 

To get successful testing, one may ask these questions s 

1) To I have objectives which let me know when the student has performed 
to a successful level? 

2) What skills and competencies are necessary to achieve the objectives? 
What will enable him to perform well on this objective? 

3) What methods will best teach the skills and competencies necessary to 
realize the objectives? 

4) Does my test ask the student to use the skills and competencies in the 
right order in order to achieve my objectives? 

And occasionally, 

5) Where did I fail? 

or 

6) Where did he fail? 

Summarize 



Hext Weeks 

Constructing objectives. 




Read Hager, Preparing Instructional Objectiv es. 
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LESSON TWO 



BEP AVI ORAL OBJECTIVES 

1, In the simplest terms ^ behavioral objectives involve two basic aspects 

1) Overt , measureable objectives, action that can be observed and . 
measured by some sort of standard 

and 

2) Stop points— points of competence whereby the teacher has determined 
that the student has reached the point of diminishing returns* It 
is either time to change the task or to make it more sophisticated* 

The good objective has both of these qualities. It asks for a certain 
type of objective behavior 5 that is , behavior which two people can see and 
agree upon according to a certain set of criteria* It also asks for certain 
stop points 5 points which demonstrate competence to a certain degree if not 
total mastery* 

2, The filmstrip and the audio-tape, . ' Look for 

three properties in each of the objectives stated) 

1* Does the objective ask for a certain action to be performed, and is 
the action overt a that is, does the learning process make the student 
modify his behavior in some way which the teacher considers desirable 
and indicative of learning? 

2. Does the objective set forward a stop pointy or a level of mastery 
Cor competence) to be achieved? Can you tell certainly when the 
stop point has been reached? 

3* Can you see how this process learned could be an enabling process 
(or skill) necessary for a more complicated operation? 



3* Hager points out that certain wordn are better than others as forms for 
stating instructional objectives* Of the words given below, some are too 
general for use as behavioral objectives^ some are useful * but rather in- 
specific 5 and others call for fairly specific behavior* Using the symbols 
P (poor) * F (fair) s and G (good), pick out the proper symbol for each of the 
phases given below, 

1) To understand the reasons for.*. 4) To analyze three types,*. 



2) To make up a bar graph showing* . . 5) To ascertain two ways of.*, 

3) To show the relationship... 6) To demonstrate that... 
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7) To know the cause of,.* 

8) To define by function 



9) To derive four math functions. 



10) To he aware of the effects of... 



Overlay with correct answers imposed over test. 

The type of objectives outlined in the VIliCET filmstrip and the Kager 
book may be too simple for adult education or complex courses. However, the 
principle articulated in these resources can be applied to more complex mater” 
ial* 

Transparency Four 

Think about an objective for a college course. Is it possible to combine 
several types of behavior in the same objective? Try to construct about four 
objectives which ask for at least two observable behaviors. Remember 3 the 
idea is to modify random behavior into productive behavior* 

Overlay 

Examples 

1* List four reasons for the fall of the Roman Empire, and then ,, in 
twenty minutes 5 relate each of these causes to the conditions which 
led to the rise of the Christian Church. 

2. Define the types of actions commonly considered apolitical* 1 '* Then, 
list three character attributes which Livy considered particularly 
n Rornan" . In a sho^t essay 9 demonstrate how the ?1 Roman 1 ? attitude 
modified life activities into apolitical 13 activities* 

It should be quite obvious from these brief examples that behavioral ob- 
jectives can be as complex as the material being taught. The key rule is 
to proceed from simple behavior responses to the more complex ones based on 
the simple ones * 

Exercises for Assignment 

Reconstruct three objectives of four already written in terms of sequential* 
behavior , beginning with simple behaviors (listing, stating, defining) and 
then proceeding to the more complex (deriving * relating, demonstrating). 

Try to build your stop points into the objectives* You will be surprised at 
how much this preliminary activity will eliminate wasted time in class and 
at how the quality of testing will improve. The basic reason for this is 
that, as you define and modify the behavior of others, you increase your own 
sense of dynamics, methods , and closure. You modify your own behavior in 
modifying theirs * 



*By a MULTIPLE OPERATION we mean the combination of at least two behavioral 
operations in sequence. 



LESSON THREE 



VALIDITY AND RELIABILITY 



The relationship between objectives, methods, and the test given, in terms of 
the test , is called the Validity of the test. In essence, it is a test of 
fairness of objective and methods, not only in terms of fairness to the student, 
but also in terms of the integrity of the teaching process itself „ The idea 
of validity is developed most completely in statistical analysis but that is 
too detailed for a short course* 

For our purposes, however, perhaps we can think of validity in its nan- 
statistical form. The most direct relationship which a valid test establishes 
is a correspondence between objective and evaluative instrument. The higher 
the correspondence between the objective and the test item, the higher the 
validity, generally providing that the secondary relationship between objec- 
tive, method and evaluative instrument is observed. That means, in simple 
terms, you will realize your objectives if the methods develop the skills and 
competences set out in the objectives. 



Transparency Five 



Supposing, that as a teacher in a poetry class, you wanted to have the class 
write limericks. Given this definition of a limerick, what would your ob- 
jectives be? Hoxtf would you arrange a sequence of teaching it? How would you 
test it? 

7 'A limerick is a humorous five line poem form, rhyme pattern 
A'-A-B--B-A s and it relies on a special set of circumstances, usually 
given in the second line, to establish its humorous character. It 
also generally uses alliteration as a humorous device. ” 

Overlay 

1. Objective. To have each student be able to write three humorous 
limerick with a A— A— B—B— A pattern, and ironic or unusual condition 
stated in the second or third line, and using alliteration in the 
last line. 

What word in this objective is not behavioral? Why would it be nard 
to totally realize this objective? 
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2. Method, Give several examples to class* Pick out rhyme schemes. 

Have class compare the second lines for irony , unusual situations. 
Discuss how irony is developed in third, fourth and fifth lines. 

Show how alliteration points up irony 5 ask class to generalize about 
desired effect. Practice a few for them, 

3, Test, Have them construct their own limerick. You should know what 
you are looking for 5 and this should be a valid test of the objective. 

For fun: There once was a chavelier named Gates 5 

Who was quite a wizard on skates 9 

He fell on his cuttless , it rendered him tuftless 
He * s now quite desperate for dates. 

Have students analyze a test from history or from the literature department in 
order to ascertain two things? 

1, Is there a sense of correspondence between the test items and the 
implicit objective of the unit? 

2* Are there terms used in the test which would tend to lead students 
astray, (Ex, 5 ^Humorous” in the definition of limerick is difficult 
to interpret.) 

Reliability 

In general, reliability is another relationship? this time it is the rela- 
tionship between the material and the consistency of the person examined. In 
simple terms 3 if a person is given a reliable test on learned material or pro- 
cesses «, he will be able to take the same test in another form and do about as 
well as he did previously* 

Transparency Six 

Examine the following statements and questions, Gan you see that they are in 
some sort of rank order? Kow s specifically, is the first example different 
from the last example? Which question, just by the form s would you rather 
write on? Which would be most reliable as a measure of true learning? Assum- 
ing that these are questions or tasks from a college course s which would you 
be able to write on next week? Next year? 
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1) Tell everything you knew about the rise of the Medieval Church, 

2) TJhy was there a Medieval Church? 

3) What factors contributed to the rise of the Medieval Church as an 
economic institution which set economic standards during the Middle 
Ages? 

4) Why was Pope Gregory VII extremely concerned about the sale of cleri- 
cs] offices * and how does his concern show increasing awareness of the 
role of the Church;* in all phases of Medieval life? 

5) Of the three major influences which made up Medieval life s list one 
major institution which bore traces of all three and then demon- 
strate* through the documents used in class, how each of these in- 
finances was carried in laws* commentaries, or catalogs of the 
erature of the institution* 

Overlay 

In comparing the extremes, we aee that the first question is so general 
that almost no one would seriously consider it. No criteria are established 
in the quest ion- any datum used would be fair game. The last question, on the 
other hand, requires a quite specified answering process, "One could change this 
question by specifying the institution x-jithout too much affecting the answering 
ability of the student who has ^learned 1 ** 

Point 

The reliability of a given test can be increased by the amount of concentra- 
tion on process detailed in the question. How do you want the student to 
answer it? By knowing how you want the student to answer it, you will know 
better why you want the student to answer it. And, if that sense of purpose 
has been implicit in the objectives of the unit and the methods of the unit, 
you probably will increase the reliability of the test in general. 



Summarize 




For the next lesson, please bring an example of an objective test and one 
essay test that you have* given. In the objective test, take five items at 
random and write the thought process that you were trying to have the stu- 
dents use to solve the question. Then consider the essay exam in the same 
manner, try to find out those things that you expect the student to do in 
answering the question. 
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LESSON FGUP. 



TYPES OP TESTING 



The type of test one selects for a given un? t will depend on two principal 
criteria? 

1) TThat did the teacher ask the student to do in his objectives? 

2) What skills and insights were developed through the methods of the 
classroom experience that can be tested? 

A corrolary to No a 2 may be testing of processes developed, What research and 
inquiry processes were developed during the uni 1 , and how are these most 
appropriately tested? 

While Nos, 1 and 2 should he fairly well understood as a result of the previous 
lessons, the corrolary may need additional illumination. 

Every teacher probably uses some process in the design of a unitj and he may 
use several at the same time without being cognizant , of them* When a 
teacher works from the specific to the general , or the general to the speci- 
fie, he is probably using some process whereby the material is made systematic , 
rank values of importance are assigned to data., and ideas are presented with 
a sort of underlying logic . This system or process is seldom tested in the 
overwhelming majority of exams, however. In fact, most units are presented 
on a rather day to day basis without a strong sense of category and continuity 
to the student, so perhaps some of the best part of teaching is overlooked - 
it remains the property of the instructor and the student sees the unit as a 
body of information to be assimilated rather than as a process of inquiry to 
be mastered. 



Transparency 

In setting up a un±t 3 one can become aware of the underlying process he is 
actually teaching by asking himself the following questions? 

1) What values underlie the material X am presenting? Why is this in- 
formation necessary for a true understanding of the course? 

2) What specific ideas can be illustrated through the subject matter of 
this unit? Can they be arrived at inductively? Can they be measured 
with some objectivity? 

3) What skills are necessary to develop this unit (data) into objective 
generalizations ? 
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(4) Is there a priority or order of ideas to be mastered in order to pro- 
vide a sense of continuity to the course? 

5) Is there room within the context o-. both subject matter and values 
of the student to test his oxm motions and to contribute to the 
dialogue of the class? 



Note that the process invloved in this question pattern is a process leading 
from the subjective to the objective, values and norms to measurable skills 
and methods * 

Note t Designing units for process is not a skill which is mastered in two 



weeks or even two years, sometimes „ Father, it is a skill mastered 
through continued awareness, and progress in it can be measured by 
transition from formal teaching, the teaching of forms, to functional 
teaching, the teaching of functions. Independent projects are a good 
test of functional teaching. 



Transparency 

Testing for function can be accomplished through any of the three common 
means of examination - essay exams, objective tests, or performance tests. 

Let us take each of these three and see how each can be effectively used. 

The objective test will be treated as a separate unit in the next lesson, 

1* Performance tests. The performance test is a very effective test 
for process and skills 'a cause there is a high degree of corres- 
pondence between objective and test. In a previous example, we 
mentioned changing a tire. A performance test for this objective 
would be to have a student actually change a tire. Other more 
sophisticated tests would be to have students actually x^rite a 
poem, a short story , a book, design an experiment in science and 
carry it out according to certain standards, designing a system for 
solving a problem, or producing a conceptuaMged model of a certain 
molecule. The best test of a performance exam is that it puts some- 
thing tangible into the hands of the student x^hich he has created by 
following a set of procedures. 

T ransp arencp 



2 e Essay tests. An essay test is probably the easiest type of test to 
construct, but the hardest type to correct and evaluate. However 9 
to more thought that goes into the construction of an essay teat, the 
better the general testing will be. 



Overlay 
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The essay test can he anything from a direct question to a proposi- 
tion* which can be treated according to a thought process. 

In the following examples., note the processes involved in. setting up 
the question and what the student is asked to do in answering the 
question j 

A, What factors led to the South’s defeat in the Battle of Gettys- 
burg? (Descriptive — Recall) 

B* List three tactical errors which General Lee made at the Battle 
of Gettysburg and analyse them in terms of chronological sequence 
demonstrating that one error led to the other, 

(Analytical - recall , interpretative) 

G * In discussing military history^ one can talk of warfare in terms 
of strategy and tactics. Strategy can he thought of as the 
rationale of the campaign y the objectives whereby one force will 
achieve some major goal which the antagonist does not want him to 
achieve. Tactics, on the other hand* connote the idea of field 
operations* These operations are the 5 'how 7 of the encounter 
whereby the enemy is manuevered into positions whereby his objec- 
tives are frustrated and he will be destroyed as an efficient 
fighting force with acceptable losses to your forces. 

Tilth these definitions in mind* read the account of the Battle of 
Gettysburg* Then state whether you believe that for the South 
this was a strategic defeat or a tactical defeat. Be sure to cite 
at least tnree factors in the account that confirm your thesis* 
then compare this battle to the other two battles studied during 
the unit and give a rationalized decision as to which battle was 
most successful in terms of strategy and in terms of tactics. 

You may wish to cite two different battles in answering this. 



(Propositional question 5 recall 3 generalization ? 
evaluation , and interpretation in a comparative 
sense.) 

TJote these three questions. TCiat is the process required in 
each? How is the objective obvious in each? Gan you see three 
separate aspects in the third question? (Definition, analysis 3 
comp ar is on- judgment) „ A view of the functionality of the third 
question can be seen by the simple observation that this is the 
type of question which would be given in a course on planning 
for potential Army officers. 



A propositional question is one which puts forward a premise which has to be 
considered in answering a question. 



T ransp aren cy 



The fundamental process in test design is basically simple. 

A test can be seen as involving three distinct processes- 

1) Recall 

2) Recall and generalization 

3) Recalls generalization,, and interpretation 

Recall tests the memory and should probably be limited to factual infor- 
mation and the simple generalizations which are made on directs factual 
data. 

Generalization occurs on several levels, A good way to see this is to 
visualise a set of conditions which are necessary to make a given gen- 
eralization r they may go beyond the data in that they are true condition- 
ally . 

Interpretation general^ means cause and effect thinking 9 systems 
design B and location of conditions which make phenomena comparable 
within a given frame of reference. Skills generally have to be developed 
before this type of question can be answered. 

Assi gnment " 

Review the last assignment from the point made in lesson four: list two 
factors you would try to include in objective tests. 
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LESSON FIVE 



OBJECTIVE TESTING 



Transparency 

It is common knowledge that objective tests are easier to grade than essay 

tests. Can you give three reasons, in addition to this, for using objec- 
tive tests? 

Overlay 

Here are some, possibly all, of the reasons for using objective testing. If 

you have two of these, you have done well, 

1) They have a broader scope; more information can be tested In an objective 
test than can be tested in an essay test. 

2) They make students have a greater degree of accuracy of data? there is less 
room for the student to weasel around the answer. You know if he really 
knows it or is just fishing. 

3) They tend to make the group more comparative in that each student is asked 
to encounter the same data and treat it in the sane way, making it easier 
for the instructor to discriminate as to who knows and who ’‘really" knows. 

4) They are more treatable statistically. It is easier to compare tests 
against each other, and the statistical evaluations of reliability and 
validity run much truer for objectives tests. 

5) They generally make re-teaching easier for one knows precisely which areas 
need attention. 



Transparency 

Can you now list three disadvantages for objective tests? Here are same of 
the most common criticisms. 
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